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This  paper  derives  the  output  covariance  function  of  the  Adaptive  Line  Enhancer 
(ALE)  for  the  case  of  a single  known  sinusoid  in  uncorrelated  noise.  An  important  applica- 
tion of  this  function  arises  when  deriving  the  detection  performance  of  a processor  incorpo- 
rating the  ALE  as  a prefilter.  Eor  this  case,  it  is  necessary  to  derive  expressions  for  the  means 
and  variances  of  the  spectral  estimates  (DFT  bin  components)  at  the  output  of  the  processor. 
When  the  covariance  function  of  the  ALE  output  is  known,  it  is  possible  to  compute  these 
spectral  means  and  variances. 

This  paper  contains  an  expansion  of  the  derivations  by  Medaugh ' for  the  covariance 
function  and  does  not  assume  a necessarily  long  filter  length  compared  to  signal  period  nor 
that  the  signal  frequency  be  bin-centered.  In  addition,  the  mean  and  variance  derivation  con- 
tained herein  are  extended  to  the  case  K < L where  L is  the  adaptive  filter  length  and  K is 
the  number  of  DFT  points  The  expressions  for  covariance  function  and  filter  output  DFT 
means  and  variances  as  derived  in  reference  1 are  shown  to  be  correct  as  long  as  the  following 
conditions  are  met: 

1 . The  filter  length  L equals  the  number  of  points  k in  the  DFT. 

2.  The  signal  frequency  wq  is  given  by  ccq  = jrn  L <n  = integer),  where  L is  the  filter 
length  and 

3.  The  signal  frequency  coq  is  not  allowed  to  approach  closely  oo  = 0 or  co  = n radians/ 
sampling  interval.  This  corresponds  physically  to  coq  bounded  by 

7T  / L I \ 

L < w0  < ^ \ !.  / 

A general  expression  for  the  output  covariance  function  is  developed  when  these  con- 
ditions are  not  met.  An  interesting  result  occurs  when  condition  2 is  not  met:  the  filter  out- 
put contains  a small-magnitude  nonstationary  component  due  to  the  finite  length  of  the 
filter. 

Section  2 provides  a brief  introduction  to  the  ALE  and  outlines  its  operational  char- 
acteristics. A specific  application  ot  the  ALL  is  presented  and  a motivation  is  given  to  obtain 
the  output  covariance  function.  Section  3 provides  a detailed  derivation  and  discussion  of 
the  covariance  I unction  and  gives  examples  ol  limiting  cases  and  first-order  approximations. 
Section  4 applies  the  covariance  function  to  a specific  application  to  find  the  spectral  means 
and  variances  of  ALL  output  DL  Ls. 
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2.  THE  ADAPTIVE  LINE  ENHANCER  (ALE) 

PROPERTIES  OF  THE  ALE 

The  Adaptive  Line  Enhancer  (ALE)  is  a processor  designed  to  separate  the  relatively 
narrowband  signals  (i.e.,  sinusoids)  contained  in  an  input  sequence  from  the  relatively  broad- 
band components  (i.e.,  broadband  noise)  in  the  input.  A block  diagram  of  the  ALE,  shown 
in  Figure  1,  clearly  defines  the  implementation  of  a linear  prediction  filter  in  the  lower  chan- 
nel. The  operation  of  the  ALE  has  been  discussed  in  detail  in  the  references  cited  here  (2, 

3.  4.  5)  and  only  will  be  summarized  at  this  time.  The  basic  principle  of  operation  is:  the 
narrowband  components  of  the  input  sequence  are  strongly  correlated  over  time  and  thus 
may  be  predicted  with  accuracy  by  the  linear  prediction  filter.  The  broadband  components 
of  the  input,  however,  have  appreciable  correlation  only  over  a short  time  and  are  not  pre- 
dictable with  any  degree  of  accuracy.  The  input  sequence  is  split  into  two  channels:  one  is 

delayed  by  A sampling  periods  (denoted  by  the  block)  and  then  input  to  the  linear  pre- 
diction filter;  the  other  channel  is  fed  directly  to  a summing  junction  from  which  the  filter 
output  is  subtracted.  The  linear  prediction  filter  consists  of  an  L tap  tapped-delay-line  (TDL) 
the  taps  of  which  are  multiplied  by  the  L weights  of  the  adaptive  weight  vector  (see  Figure  2). 


input 

sequence, 

x(k) 


Figure  1 . Block  diagram  of  the  Adaptive  Line  Enhancer  (ALE). 


Figure  2.  Expanded  block  diagram  of  ALE. 
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Tlie  weights  are  denoted  by  the  Wj  multipliers  and  these  products  are  then  summed  to  pro- 
duce the  filter  output  at  time  k,  denoted  by  r(k).  Mathematically,  the  filter  output  is  given 
by  the  convolution  sum 

L-l 

r(k)  = ^T  Wj  (k)  x (k  - j - A)  (1) 

j^O 

where  the  filter  weights  have  been  written  as  a function  of  time  argument  k to  reflect  their 
adaptive  nature.  The  filter  output  is  then  fed  into  a summing  junction  and  subtracted  from 
the  original  data  sequence.  The  purpose  of  the  filter  in  the  delayed  channel  is  to  predict  the 
current  value  of  the  data  input.  x(k),  based  upon  a linear  combination  of  past  input  samples 
x(k  - A)  through  x(k  - A - L + 1 ).  The  filter  is  described  as  linear  prediction,  since  the  filter 
output  r(k)  is  a prediction,  x(k).  of  the  current  actual  input  sample  x(k).  Thus  the  output  of 
the  summing  junction,  denoted  by  e(k).  may  be  thought  of  as  the  error  between  the  actual 
value  x(k)  and  estimate  x(k): 

e( k ) = x(k)  - x(k).  (2) 

If  the  criteria  for  the  prediction  filter  is  to  minimize  the  mean  square  of  this  error,  then  it  is 

well  known"  that  the  resultant  filter  weights  W*  (or  coefficients)  must  satisfy  the  discrete 
Wiener-Hopf  matrix  equation: 

W*  = R-1  P (3) 

where  R is  the  L X L autocorrelation  matrix  of  the  input  sequence  and  P is  the  L X 1 auto- 
correlation vector  with  autocorrelation  elements 

rxx  (A> 

rxx  (A+l ) 

P=  (4) 

rxx  (A  + L - 1 ) 

To  solve  equation  3 tor  the  W*.  sometimes  called  the  Wiener  solution  or  optimal 
weight  vector,  requires  perfect  knowledge  of  the  autocorrelation  lags  rxx  (V).  but  generally 

these  are  never  known  exactly.  The  ALT  obviates  this  requirement  by  solving  for  the  W*  via 
an  iterative  technique  called  the  LMS  (for  least  mean  square)  algorithm.  This  is  a gradient 

descent  type  of  algorithm  which  has  been  shown7-  8 to  converge  to  the  Wiener  solution  for 
uncorrelated  stationary  inputs.  The  algorithm  starts  with  an  arbitrary  initial  weight  vector 
W(0)  and  updates  the  weight  vector  elements  through  the  recursion 

W(k  + I ) = W(k)  + 2#ie(k)  X(k).  (5) 
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In  equation  5,  X(k)  is  the  vector  consisting  of  the  contents  of  the  TDL  at  time  k,  e(k)  is  the 
error  signal  at  time  k and  pi  is  a feedback  constant  which  controls  the  speed  of  adaptation. 

A stability  requirement  on  pi  (references  7.  8)  is  that  it  be  bounded  by 


o < pi  < 1 Amax 

where  Xm  lx  is  the  largest  eigenvalue  of  the  input  autocorrelation  matrix  R. 


(6) 


Figure  2 shows  that  the  error  value  e(k)  is  multiplied  by  the  vector  2ptX(k)  and  then 
used  to  update  the  individual  Wj  according  to  the  LMS  algorithm.  During  the  adaptation 

period,  the  algorithm  updates  the  filter  coefficients  such  that  the  filter  output  converges 
toward  the  highly  correlated  (and  thus  highly  predictable)  components  of  the  input.  The 
minimization  of  mean-square-error  criteria  aligns  the  phase  of  the  narrowband  components 
in  the  data  sequence  and  filter  output,  which,  after  convergence,  removes  the  narrowband 
components  from  the  error  sequence  e(k).  This  is  the  steady-state  operation  of  the  filter  in 

which  the  filter  weights  may  be  represented  by  the  Wiener  solution,  as  shown  analytically 


and  experimentally.' 


In  steady-state,  the  weight  vector  converges  in  the  mean  to  the  Wiener  solution.  How- 
ever, at  any  one  given  time  k the  instantaneous  weight  value  Wj(k)  is  given  by 

Wj(k)  = Wj*  + Vj(k)  (7) 

where  Wj*  is  the  j^1  element  of  the  optimal  weight  vector  and  V:(k)  is  a zero-mean  gaussian 

noise  component  with  variance  given  by  p/c~  (c-  = total  input  power,  signal  plus  noise).  This 
component  is  called  the  misadjustment  noise  and  is  due  to  the  use  of  the  LMS  algorithm  as  a 
finite  length  approximation  to  the  true  gradient  (reference  2).  Furthermore,  reference  2 
shows  the  misadjustment  noise  is  uncorrelated  from  weight-to-weight ; that  is, 

El  Vj(k)  Vj(k)l  = ptc~  6(i  - j),  for  all  i,  j.  (8) 

The  misadjustment  noise  and  the  converged  weights  Wj*  are  also  uncorrelated.  Therefore, 
due  to  the  zero-mean  property  of  the  V j ( k ) , and  that  the  Wj*  are  deterministic: 

El  Wj*  Vj(k)]  = Wj*  ElVj(k))  = 0;  for  all  i.j.  (9) 

Since  the  variance  of  Vj(k)  is  proportional  to  /a.  it  is  evident  that  the  variance  of  the  misad- 
justment noise  can  be  made  arbitrarily  small  by  decreasing  p.  This  translates  into  an  ability 
to  approximate  the  Wiener  solution  W*  to  within  any  desired  bound,  with  the  trade-off  that 
the  LMS  algorithm  takes  increasingly  longer  to  converge.  For  many  problems  of  practical 
interest,  however,  this  is  of  no  consequence,  and  thus  this  paper  will  treat  the  converged 
weight  vector  as  the  Wiener  solution  W*. 

AN  APPLICATION  OF  THE  ALE  AS  A DETECTION  PREFILTER 

The  ALE  provides  a real-time  method  of  separating  the  narrowband  input  signals 
from  the  corruptive  broadband  noise  components.  A primary  function  of  the  ALE  is  as  a 
detection  prefilter  as  shown  in  Figure  3.  In  this  implementation,  the  narrowband  components 
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x (k) 


Figure  3.  Use  of  the  ALE  as  a predetection  filter. 


appear  at  the  filter  output  r( k ).  which  is  then  used  as  the  input  to  a DFT.  Detection  of  a 
signal  with  frequency  ojq  is  performed  by  examining  the  magnitude  square  of  the  coq  fre- 
quency component  and  comparing  it  to  a predetermined  threshold  level.  Introductions  to 

the  detection  problem  in  general  may  be  found  in  many  texts9,  and  only  the  framework 
of  the  problem  is  presented  here  to  provide  motivation  for  obtaining  the  covariance  function. 

The  case  examined  here  is  a purely  sinusoidal  signal  s(k)  corrupted  by  an  additive 
gaussian  noise  sequence,  n(k).  Let  s(k>  be  defined  by 

s(k)  = A sin  (cogk  + 0)  (10) 

where  A is  the  signal  amplitude,  coq  is  the  signal  frequency  and  0 is  the  unknown  initial  phase 

ot  the  sinusoid.  Let  the  additive  noise  n(k)  be  a white  zero-mean  sequence  with  variance  v~\ 
that  is 

E l n( k) J =0  (Ha) 

E [n(k)  n(p)J  = v~  6(k  - p)  (lib) 

where  E|  • j denotes  the  expectation  operator  and  5(  * ) is  the  Kronecker  delta  operator.  With 
the  signal  term  and  noise  sequence  represented  by  the  preceding  equations,  the  received  data 
sequence  x(k)  becomes 

x(k)  = s(k)  + n(k).  (12) 

Now  consider  the  operation  of  the  converged  prediction  filter  upon  x(k).  Since  s(k) 
is  completely  deterministic  and  zero-mean,  the  variable  x(k)  is  a zero-mean  gaussian  random 
variable  for  all  values  of  k.  The  filter  output,  denoted  by  r(k|0 1 to  reflect  the  dependence  on 
unknown  initial  phase  0,  is  defined  as 

L-l 

r(k|0)=Y  W:*  x(k-j- A).  (13) 

^ J 

j=0 

Thus  r(k|0)  is  a linear  combination  of  previous  input  samples.  The  summation  of  the  L gaus- 
sian variables,  therefore,  produces  the  gaussian  variable  r(k|0).  As  shown  in  Figure  3.  the 
detection  processor  then  operates  upon  the  filter  output  with  a K -point  DFT  to  produce  the 
spectral  estimate  R(co).  The  u>q  component  of  this  estimate,  R(goq).  is  given  by 

R(coq)  = u + jv  (14) 
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where 


u 


K-l 

r(k|0)  cos 

k=0 


v 


K-l 

^ r(k!0)  sin  ojQk. 
k=0 


(15a) 


(15b) 


The  variables  u and  v as  defined  in  equations  14  and  1 5 are  recognized  to  be  the  real  and 
imaginary  components  of  the  spectral  estimate  at  frequency  u>q.  The  statistical  independence 

of  u and  v has  been  demonstrated  in  reference  1 , and  thus  have  a joint  probability  density 
p(u,  v)  given  by 


p(u,  v)  = p(u)  p(v). 


(16) 


It  may  be  seen  from  equations  1 5a  and  1 5b  that  for  a given  cjq  the  variables  u and  v are 

formed  by  linear  combinations  of  the  output  samples.  Since  the  individual  r(k|0 ) are  gaus- 
sian  variables,  the  scaling  by  cos  cjQk  and  summation  cause  u to  be  a gaussian  variable.  A 

similar  argument  holds  for  v.  Thus  the  u,  v are  gaussian  random  variables  with  calculable 
means  u and  v and  variances  ou“  and  ov~,  which  completely  specifies  the  joint  probability 
density  of  equation  16: 


p,u- vi  ‘v4„  **■  B ^:]  jk, cxp  B^: 


(17) 


(18) 


Thus,  if  one  has  knowledge  of  the  mean  values  u and  v (defined  by  E(u)  and  E(v).  respec- 
tively) and  the  variances  ou“  and  ay.~,  the  joint  probability  density  function  is  immediately 
known. 


Consider  first  the  variable  u. 


The  variance  of  u is  defined  by  ou“.  where 


°u“  = E{ u“ } - [Eju} | 


By  applying  the  definition  in  equation  15a  to  equation  19,  ou“  becomes 
K-l  K-l 

S I s coq(! 


au  = E 


k=0  «=0 


K-l 

K-l 

E 

^ r(k|0)  cos  ccqE 

E 

r(t|0 ) cos  ccqS 

i^o 

i° 

1 11 
i — / 

(19) 
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k-1  K-l 

ou2=X  zl  [ t^r(k|0 ) r(C|0)}  - t:{r(k|0>^  ] cos  «^0k  cos 


k=0  (!=0 

(20) 

The  autocorrelation  function,  0r(m)  is  defined  as 

0r(m)  = Hjr(kid)  r(k  + mid)} 

(21) 

and  the  covariance  function,  7r(nt),  as 

7r(m)  = 0r(m)  - h{r(k|0 )}  H { r( k + m|d)}. 

(22) 

Then,  the  expression  for  the  variance  of  the  statistic  u becomes 

K-l  K-l 

ou“  = ^ ^ 7r(C  - k)  cos  cjQk  cos  coq? 
k=0  (!=0 

(23) 

Similarly,  one  may  derive  for  the  statistic  v the  following  expression: 

K-l  k^l 

ax~  = \ 'y  7r(8  - k)  sin  cjqIc  sin  ojQt!  (24) 

k=0  9=0 

Thus  the  variances  of  the  u and  v statistics  are  dependent  upon  finding  the  covariance  func- 
tion 7r(C  - k).  This  derivation  is  pursued  in  the  following  section. 
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3.  DERIVATION  OF  THE  ALE  OUTPUT  COVARIANCE  FUNCTION 


First,  the  expression  is  found  for  the  expectation  of  the  output  at  time  k conditioned 
on  a knowledge  of  0 , denoted  by  E{r(k|0)}: 

L-l 

E|r(k|0)}  = E ^ Wj(k)  x(k  - j - A)  , 0<j<L-l 

j=0 

L-l 

= E ^ [Wj*  + Vj(k)J  [A  sin  [ccQ(k  -j  - A)  + 0]  + n(k  -j  — A) J . 

j=0  1(25) 

However,  the  misadjustment  noise  Vj(k)  and  white  noise  sequence  n(p)  are  uncorrelated; 
that  is, 

El Vj(k)  n(p)}  = E{Vj(k)}  E|n(p)}  = 0 
for  all  k,  j and  p.  Furthermore,  since  Wj*  is  deterministic, 

E|  Wj*  n(p)[  = Wj  * E{n(p)f  = 0. 

Similarly,  the  sinusoidal  term  is  completely  deterministic,  causing  the  cross  product  expec- 
tation between  Vj(k)  and  the  sinusoid  to  vanish.  This  reduces  equation  25  to  the  following: 

L-l 

E{r(k|0)}  = ^ Wj*  A sin  lo)Q(k  - j - A)  + 0 | . (26a) 

j=0 

A similar  derivation  gives  the  expectation  E|r(k  + m|0)}  as 

L-l 

E{r(k  + m|0)}  = ^ Wj*  A sin  [c«jQ(k  + m - i - A)  + 0| . (26b) 

i=0 

Using  equation  22  as  the  definition  of  the  covariance  function,  then  the  evaluation  of  0 (m). 
as  given  by  equation  21  is, 

0r(m)  = Ejr(k|0)  r(k  + m|0)|.  L = filter  length. 

L-l  L-l 

= E Wj(k)  x(k  - j - A)  ^ Wj(k  + m)  x(k  + m - i - A) 
j=0  ‘ HD 
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0r(m)  = E 


L-l  L-l 

[Wj(k)  Wj(k  + m)]  [A  sin  [coQ(k  - j - A)  + 0] 

j=0  i=0 


+ n(k  - j - A)]  X [A  sin  l ojq( k + ni  - i - A)  + 0]  + n(k  + m - i - A)| 

(l) 


As  before,  the  niisadjustment  error,  Vj(k),  the  converged  weight  value  Wj*.  and  the  white 


noise  sequence  n(k)  are  all  uncorrelated.  This  causes  several  of  the  cross-products  in  equa- 
tion 27  to  vanish,  which  will  simplify  the  expression.  Expanding  equation  27: 


0r(ni)  - 0 1 +0T  + 03+04 


(28) 


where 


0[  = E 


L-l  L-l 

N ^ [ Wj( k)  Wj(k  +ni)]  A“  sin  [wg(k -j  - A ) + 0 J sin  [cuQ(k  + m -i  - A)+  0| 
j=0  i=0  (29) 


0-»  = E 


L-l  L-l 

y y 


> | W:(k)  Wj(k  + m) I A sin  | ooq( k — j — A > + 0 1 n(  k + m - i - A) 
j=0  K) 


(30) 


03  = E 


L-l  L-l 

> y I Wj(  k ) Wj( k + m ) | A sin  [ u>q(  k + m - i - A ) + 0 | n(k  - j - A ) 

li=o  i=0 


(31 ) 


L-l  L-l 

y y 


04  = E 

‘ j=0  i=0 

First,  evaluate  0-> : 

L-l  L-l 
I 

0-i  = E 


[Wj(k)  Wj(k  + in ) | n(k  - j - A)  n(k  + m - i - A) 


(32) 


y [ Wj(  k ) Wj(  k + in ) | A sin  | uy(  k - j - A ) + 0 1 n( k + m - i - A ) 
j=0  i=0 


L-l  L-l 


= a y y e{ i Wj  * + V j<  k ) | | Wj  * + Vj(  k + m i | n(  k + m - i - A 1 1 

j=0  i=0 


X sin  |cjQ(k  - j - A)  + 0 | 


1 


■ 


L-l  L-l 

= A 2 2 E i|Wj*  Wi*  + Vj(k)  W>*  + Wj*  Vi(k  + In)  + Vj(k)  Vi(k  + m)| 

j=0  i=0 

X n(k  + m - i - A)}  X sin  Iccglk  - j - A)  + d\ . (33) 

However,  it  has  been  assumed  that  Wj*,  Vj(k)  and  n(k)  are  ail  uncorrelated  for  all  j and  k. 
This  causes  the  expectation  in  equation  33  to  vanish  giving 

0 2 = 0. 

Similarly,  it  may  be  calculated  that  0 3 = 0. 


Now  evaluate  0|  in  equation  29: 

L-l  L-l 


0)  - E 


12  (Wj(k)  Wj(k  + m)]  A-  sin  |wQ(k  -j  - A)  + 0] 
j=0  i=0 


X sin  [coQ(k  + m - i - A)  + 0 1 
L-l  L-l 

= A2  ^ ^ E{[Wj*  + Vj(k)l  (Wj*  + Vjfk  + m)]} 
j=0  i=0 

X sin  [aiQ(k  - j - A)  + 0\  sin  ( coq(  k + m - i - A)  + 0| . 
Again  Wj*  and  Vj(k)  are  uncorrelated  and  E^Wj*  Vj(k)}  = 0 giving 
L-l  L-l 

0)  = A~  ^ ^ E[Wj*  W * + Vj(k)  Vj(k  + m)l  sin  |u>Q<k  - j - A)  + 0 1 
j=0  i=0 

X sin  [ coq(  k + m-  i-  A)  + 0|. 


(34) 


For  the  sinusoid  in  white  noise,  it  has  been  shown  (references  3 and  4)  that  the  converged 
ve  the  form 

Wj*  =-=jE  cos  to0(J  + A) 


weights  Wj*  have  the  form 


(35a) 


where 


and 


a*  = (L/2)  SNR 
1 + (L/2)  SNR 


SNR  = \~l2v1. 


(35b) 
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Ihus.  we  have  fc|YVj*  W- * J = Wj*  Wj*.  Furthermore,  the  misadjustment  noise  is  assumed  to 
he  uncorrelated  from  weight-to-weight  but  to  have  a constant  variance  over  time: 


FI Vj(k)  Vj(k  + m)|  = fic~  6(i  -j). 

Substituting  equation  36  into  equation  34  and  rearranging,  then: 


(36) 


1.-1  L-l 

<t>\  = ^ ^ A-  Wj*  Wj*  sin  [ coq( k - j - A)  + 0)  sin  |ojQ<k  + m - i - A)  + 0| 
p0  i=0 


L-l  L-l 

, ’ V i 

+ A > / /ac~  6(i  - j)  sin  |<OQ(k  - j - A)  + 0 ! 

j=0  ,=0 

X sin  | coq(  k + m - i - A ) + 0 | 

L-l  L-l 

= \ Wj*  A sin  [co0(k-j-  A)  + 0|  'S  W,*  A 

j=0  ito 

X sin  1 ojq(  k + m - i - A ) + 0 | 

, L-l  L-l 

+ 4^  y 'S  mc“  6(i  - j)  [cos  wq(iti  - i + j) 
j=0  i=0 

- cos  1 coq(  2k  + ni  - i - j - 2A)  + 20 1]  . 

But  comparing  this  expression  to  equations  25  and  26  it  is  seen  that 
<£|  = F{r(k|0 )}  E{r(k  + m|0)} 

2 j LzJ  U! 

+ — p X/.  ^(i  - j)  | cos  coQ(m  - i + j) 
j=0  i=0 

- cos  [o)Q(2k  + m - i - j - 2A)  + 20  || 

= L jr(k|0)|  F |r(k  + m|0)| 

2 2 L_l 

+ A ^ jcos  c jqih  — cos  [ cjq( 2j  — 2k  + m + 2 A)  — 20 1 1 
j=0 


(37) 
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(38) 


a2  .2  i 

= Ejr(k|0) } E|r(k  + m|0)[  + — ~ — - cos  cjqiti 
2 , L-l 

- ■ P~~  ^ cos  [ 2ccgj  + ( m - 2k  + 2 A ) gjq  - 20  ] . 

' j=0 

Formulas  are  available  to  evaluate  a finite  sum1 1 and  several  are  listed  in  the  appendix.  The 
last  term  in  equation  38  may  be  written  in  the  form 


L-l 


sin  coqL 


/ cos  ( 2ccnj  + 0 1 = — cos  [ uWL  - 1 ) + \b  J 

Sin  COr>  u 

j=0  0 

where  1 1/  = (m  - 2k  + 2A)  ccg  - 20.  Thus  equation  38  becomes 

1 -> 

0]  = E | r(k|0 )}  E|r(k  + m|0 )[  + ^ cos  coqiii 


where  the  substitution 


SjJ  coq)  ; 


■ — ~ — Sj^Icoq)  cos  [wq(L  - 1 ) + (m  - 2k  + 2A)  wq  - 20  ] (39) 


sin  w0L 


sin 


co0 


has  been  made.  For  n(k)  a white,  gaussian  noise  sequence,  A = 1 is  sufficient  to  decorrelate 
signal  and  noise  components.  Thus  equation  39  simplifies  to 


• 2 .2  . 

0]  = E jr(k|0 )}  E |r(k  + m|0)|  + - ~ — - cos  ccgm 


A-  -2 

— SL(w0)  cos  |coq  (2k  - m - L - 1 ) + 20] . 


(40) 


This  ditlers  from  the  expression  obtained  by  Medaugh  in  reference  I by  the  inclusion 
of  the  final  term  in  equation  40.  Implications  of  this  will  be  examined  later. 

Returning  to  equation  28.  it  remains  to  evaluate  given  by 
L-l  L-l 

04  = E ^ ^ (Wj(k)  Wj(k  + m)J  n(k  - j - A)  n(k  + m - i - A) 
j=0  i=0 


L-l  L-l 

04  = ^ ^ E { Wj(  k ) Wj(k  + m)}  E{n(k  - j - A)  n(k  + m - i - A)} 
j=0  i=0 


Thus, 


L.-1  L-l 

= ^ V [Wj*  Wj*  + E{Vj(k)  Vj(k  + m)f  1 Ejn(k-j-A) 
j=0  i=0 

X n(k  + m - i - A)} . 

The  noise  sequence  n(k)  is  white,  zero-mean  and  gaussian  with  variance  v~.  Thus, 


L-l  L-l 

0^  = V ^ (Wj*  Wj*  v-  6(m  - i + j)  + uc"  5(i  - j)  v~  8(m  - i + j)| 
j=0  i=0 


L-l  L-l 

•SI 


j=0  i=0 


4a*-r>- 

L- 


cos  [wqU  + All  cos  l coq( i + All  5(m  - i + j) 


L-l 


+ ^ /re"  v~  8(m) 
j=0 


, L-l  L-l 

0^  = ~J  -V-  ^ ^ [cos  cjqU  - j)  + c°s  cjQli  + j + -All  6(m  - i + j) 
L~  j-l)  i=0 


+ /ac“  v-  L 8(m).  (41 ) 

Now  sum  over  the  i-index  in  the  first  term  of  equation  41 . The  impulse  function  is  non-zero 
only  when  i = m + j,  and  the  double-summation  reduces  to 


L-l  L-l 


V V | cos  WQ<i  - j)  + cos  wg(i  + j + -A)[  8(  m - i + jl 


z-  z- 

i=0  j=0 


■ I f 


cos  coq(  m ) + cos  ccq( 


m + 2i  + 


:ai|. 


(42) 


0 < |m|  < L - 1. 

The  index  on  i no  longer  goes  from  0 to  1.  - 1 since  not  every  value  of  j = |m|  + i lies  in  the 
interval  0 < )m|  + i < L - 1.  There  are  only  j — i m | values  of  i for  which  the  delta  function  in 
equation  42  will  be  non-zero.  The  index  i thus  has  the  value  i = j - |m|.  and 

when  j = 0 -M  = -|m|, 

when  j = L-  l-M=L-l-|m|. 
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Furthermore,  the  lower  bound  on  i is  limited  to  i = 0 and  the  upper  bound  is  i = L - 1 . Since 
m can  be  positive  or  negative  lag  in  the  range  |m|  < L - 1 , the  summation  in  equation  42  may 
be  written  as  either. 


L- 1 -m 

1=  ^ {cos  cjQin  + cos  u)Q(m  + 2i  + 2A)|,  0 < m < L 

i=0 


L-l+m 

11=  ^ {cos  cogm  + cos  c*;g(2i  - m + 2A){,  0>m>-L+l. 

i=0 

Evaluating  the  finite  summations  I and  II  according  to  the  identities  in  the  appendix 
and  substituting  A = I : 

sin  cog<  L — in ) 

I = (L  - m)  cos  cogm  + ; cos  lug  (L  + 1 )) , 


Sill 


w0 


0 < m < L - 1 
II  = (L  + m)  cos  cogm  + 


sin  <og(  L + m I 


sin 


WQ 


COS  I cog  ( L + 1 ) ! . 


0 > m > - L + 1 . 


By  employing  the  absolute  value  notation  |m|.  the  expressions  I and  11  may  be  combined 
and  the  left-hand  side  of  equation  42  written  as 


(L-  Imlt  COS  COglTl  + 


["COS  COg(  L + 


sin  ou 


0 


sin  cog  ( L - |m|) 


0<  |m|  < L - 1. 

Substituting  this  expression  into  equation  41  gives  the  final  value  for  04: 


_ 2a*“  v~ 
— - 


( L - |m|)  cos  cogm  + 


/ COS  COg(  L + I )\ 
\ sin  cog  / 


sin  cog  ( L - |m|) 


+ /ac“  v-  L 5(m),  0<|m|<L- 


(43) 


becomes 


Now  substituting  equations  40  and  43  into  equation  28.  the  autocorrelation  function 


0r(m)  = F{r(k|0)}  E { r( k + ml0)}  + -- ^c‘~  L cos  cogin 
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where 


7|(m)  = L 6(m) 

(46a) 

r -.4 

, . A-  Me-  : 

7s<m)  , 

L 

— cos  cjQin 

(46b) 

2a*-  v- 
73(111)=  , 

iL  |m|)  cos  cjQm 

(46c) 

, , _ 2a*“  v- 

7q<  in ) ~ 

/cos  ccq  ( L + 1 ) \ 

l . ) sin  co/a  ( L |m|) 

\ sin  coq  / u 

(4(id  1 

r . 2 

2”| 

7^( k,  m)  = - — — 

Sl  (coqJcos  (cjQl^k  m L l)  + 2^] 

(46e ) 

L 

J 

For  iags.  |m|  > L.  the  covariance  function  becomes 

7r(m)  = 7->(m)  + 75<k,  m)  (47) 

The  origin  of  these  terms  is  easily  understood  by  considering  the  steady-state  filter 

* 

response  as  the  superposition  of  two  processes:  (a)  a fixed  filter  converged  at  the  W:  , 
and  (b)  a broadband  "noisy"  filter  due  to  the  misadjustment  noise.  Thus,  the  7|  term  is  due 

to  the  uncorrelated  noise  sequence  passing  through  the  broadband  noisy  filter.  The  result  is 
to  produce  an  uncorrelated  noise  sequence  in  the  filter  output  which  is  scaled  by  the  product 

of  total  misadjustment  noise  power,  /ic~L,  and  white  noise  input  power,  v~ . The  term  7-»  is 

produced  by  the  sinusoid  (of  power  A“/2>  passing  through  the  broadband  filter.  As  such  it 
represents  a pure  sinusoidal  term  in  the  output  at  ccq  whose  power  is  scaled  by  the  sinusoid 

power  and  total  misadjustment  power.  The  term  73  is  produced  by  the  input  white  noise 

within  the  bandwidth  of  the  converged  filter.  This  produces  a narrowband  noise  term  in  the 
filter  output  centered  at  the  same  frequency  as  the  sinusoid,  but  with  a bandwidth  of  the 
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converged  filter.  The  finite  bandwidth  of  this  noise  process  is  evidenced  by  the  triangular 
weighting  on  the  73  component.  The  terms  74  and  75  result  from  the  finite  number  of  pre- 
dictor weights  and  are  produced,  respectively,  by  uncorrelated  noise  passing  through  the  con- 
verged filter  and  the  sinusoid  passing  through  the  broadband  filter.  Note  that  7 , 74  are 

not  functions  ot  time  argument  k and  therefore  represent  stationary  components  of  the  filter 
output  time  series.  However,  75  is  a function  of  k and  as  such  represents  a nonstationary 
component  of  the  output  sequence. 

The  terms  7] . 73.  and  73  are  contained  in  the  covariance  expression  derived  by 
Medaugh  [ 1 ].  However,  the  function  defined  by  7r(m)  in  this  paper  contains  the  additional 
terms  74  and  75,  which  will  next  be  examined  in  detail. 

Origin  of  Nonstationary  Covariance  Terms 

Consider  Figure  4.  which  illustrates  the  case  for  an  integral  number  of  signal  cycles 
contained  within  the  filter  length  L.  Note  that  for  this  case.  SL(cc0)  = 0 and  thus  the 

75(k,  m)  vanishes.  This  corresponds  to  the  continuous  case  that  the  integral  over  any  number 
ot  lull  sinusoid  cycles  must  vanish.  As  k increases,  the  signal  progresses  through  the  filter 


. . _ izr 
w0  " L 


(a)  AA  = 0 


(b)  AA  = 0 


(c)  AA  =0 


Figure  4.  Progression  of  signal  through  filter  for  integer 
(n  = 2)  number  of  cycles. 
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hut  the  integer  characteristic  of  signal  cycles  remains  constant.  Thus  75  = 0.  and  the  result- 
ing expression  for  the  covariance  7r(m)  given  by  equation  45  is  independent  of  absolute 
time  index  k.  As  coy  changes  slightly,  however,  an  incomplete  cycle  of  signal  data  is  held 

within  the  filter.  (See  Figure  5.)  The  quantity  AA  is  the  measure  of  excess  sinusoidal  cycles 
contained  in  the  filter  at  the  times  t = k | , k->,  k^.  For  the  case  ojq  - 4w/L  in  Figure  4.  there 

is  no  cycle  excess  for  any  value  of  t.  However,  the  absolute  time  value  k causes  an  uncancelled 
cycle  excess  when  the  frequency  coy  # 2n7r/'L.  Furthermore,  the  “polarity"  of  AA  oscillates 

between  its  extrema  with  a frequency  given  by  2coy.  This  phenomenon  can  be  seen  by  trac- 
ing the  cycle  excess  in  (a),  (b)  and  (c)  of  Figure  5.  From  (a)  to  (c),  the  sinusoid  itself  has 
traversed  n/2  radians  through  the  filter,  while  the  cycle  excess  has  gone  from  its  minimum  to 
its  maximum,  a transition  of  tr  radians  for  a sinusoid.  This  is  reflected  in  the  time-dependent 
term  7^(k,  m)  which  has  oscillations  at  a frequency  2w q.  For  fixed  lag  ihq,  the  value  of 

7j(k.  ihq)  will  oscillate  about  its  mean  value  with  frequency  2toy  as  the  time  index  k 
increases.  For  fixed  time  value  ky.  the  function  7r(ky.  m)  behaves  cosinusoidally  as  the  lag 
m is  increased. 

Being  dependent  upon  the  time  index  k.  7<^(k.  m)  as  defined  by  equation  4b.  repre- 
sents a nonstationary  process  occurring  within  the  filter.  I bis  is  due  to  the  finite  length  of 


_ 5rr 
“0  "2L 


filter  length  L 


(a)  AA  = cycles 


/■"S 
✓ \ 
' \ 


s ✓ 
s / 


\ (b) 


/ X 
/ \ 


(c)  AA  = % cycles 


Figure  5.  Progression  of  signal  through  filter  for 
non-integer  number  of  cycles. 


the  filter  being  “mismatched”  to  the  signal  frequency.  However,  there  are  two  reasons  why 
this  term  essentially  can  be  neglected: 

1.  As  time  k increases,  the  average  over  k of  7^(k,  m)  is  zero. 

2.  The  amplitude  of  75(k,m)  for  all  k,  m is  typically  bounded  much  smaller  than 
the  amplitudes  of  the  other  terms  in  the  covariance  expression  45. 

Figure  6 shows  a plot  of 

Sl(cjq)  sin  ccqL 
L L sin  coq 

vs.  coq  which  illustrates  the  frequency  intervals  for  which  751k,  m)  may  be  neglected.  For 
this  figure  L = 64,  but  the  plot  is  representative  of  all  values  of  L.  The  envelope  of  Sl<gjq)/L 
decays  quickly  and  is  bounded  by  1/L  for  coq  near  ir/2.  For  purposes  of  comparison,  con- 
sider 72(m)  which  is  another  narrowband  component  of  the  covariance  expression  equation 
45.  It  is  seen  that  the  amplitude  of  75U,  m)  is  much  smaller  than  A-pc~L/2  for  frequencies 
away  from  the  DC  bin  by  forming  the  ratio  of  the  two  amplitudes: 

A“  /ac~  c , , 

Amp  (7c(k,  m)  ] T ~ lUJ°  , 

= Si(GJn). 

Amp  [72(m)J  A:  pc2L  L L u 


Figure  6.  Plot  of  Sl(cjq)/L  vs.  u)q  for  L = 64. 
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Thus,  the  amplitude  ratio  of  7|(k,  m)  to  the  narrowband  component  7 -din)  is  given  by  the 
plot  of  Figure  6.  For  tt/L  < coq  < rr  1 L-l  l/L.  the  -ysik.  m ) term  may  be  neglected  without 
introducing  appreciable  error  into  the  covariance  function  7r(m). 

P 

The  second  term  under  consideration.  741m)  as  given  by  equation  47.  is  next  to  be 

examined.  Its  effects  upon  the  total  covariance  function  can  best  be  seen  by  comparison 
with  the  narrowband  covariance  component  73(1111.  This  term  and  7 111 ) both  contain  the 
scale  factor 


L~ 

and  thus  may  be  compared  easily.  This  is  shown  in  Figures  7a.  7b  and  7c  which  compares 
the  two  terms  as  a function  of  lag  (ml  for  three  different  frequencies  (a  filter  length 
L = 1000  was  chosen).  Figures  7a  and  7b  illustrate  that  the  narrowband  component  73(111) 

dominates  71(111)  for  coq  = 7r/10  and  coq  = 7r/100.  The  narrowband  component  has  a tri- 
angular envelope  due  to  the  ( L - |m|)  weighting  and  thus  only  as  the  lag  |m|  approaches  L 
does  74(111)  become  appreciable  in  magnitude  to  731m).  For  coq  = 7r/1000.  however.  Figure 

7c  shows  that  74(111)  becomes  appreciable  in  relative  magnitude  at  about  m = 0.2L.  This 

frequency  represents  a line  at  the  boundary  between  the  DC  bin  and  bin  centered  around 
co  = 27t/L  = 2tt/1000.  For  this  frequency,  the  74(01)  should  not  be  disregarded,  especially 
for  large  m. 

A similar  behavior  appears  as  coq  approaches  n radians/sample  interval.  The  term 
74! m)  is  now  a narrow  band  component  with  frequency  approaching  n.  but  with  an 
envelope  similar  to  that  of  74(111)  in  Figure  7c.  It  coq  is  located  at  the  bin  boundary  between 
the  (o  = 7r  and  co  = ( L - 2 )7r/ L bins,  then  74(111)  will  be  appreciable  in  magnitude  for  mid- 
range values  of  111  and  should  not  be  disregarded. 


m = .01  L j 

/ 

d 

/ 

\ / 


(a)  Wq  = 7r/10 


( b ) cjg  = nl  1 00 


•- — 73(111) 

O — -O  > 2<m) 


Figure  7.  Relative  values  of  covariance  function  components 
(a)w0=  *00  rr/L,(b)co0=  10  tr/L.  (c)  u>0  = tr/L  (L  = 1000). 


4.  CALCULATION  OF  DFT  MEAN  AND  VARIANCE  FOR  ALE  OUTPUT 


This  section  applies  the  covariance  function  toward  obtaining  expressions  for  the 
ALE  filter  output  DFT  mean  and  variance.  The  general  outline  of  Section  2 is  followed 
here,  and  the  derivations  from  Section  3 are  utilized. 


As  derived  in  Section  3,  the  following  expression  for  the  covariance  sequence, 
7r(m),  will  be  used  in  the  subsequent  DFT  mean  and  variance  calculations: 


7r(m)  = /ac-  v~  L 5(m)  + 


A"  u c-  L,  2a  -r„  , u 
| — + ~^r~  <L-  m ) 


cos  ojn  m 


2a*~  v~  /c°s«0(L+l)^ 

HT  i ..oT r'n“°IL' 


|m|) , 0 < |m|  < L- 1 


_ A-  /zc~  L. 


:os  coq  m . |m|  > L . 


(48) 


In  this  section  the  DFT  component  means,  denoted  by  E(u)  and  E(v).  are  derived,  where  u 

and  v are  defined  by  equations  15a  and  15b,  respectively.  Additionally,  the  DFT  compo- 

■> 

nent  variances,  au“  and  ay-,  are  derived. 


DERIVATION  OF  COMPONENT  MEANS 

Begin  by  deriving  the  expectation  of  u.  the  real  component  of  the  output  DFT  at 
frequency  cjq.  for  the  case  of  signal  present.  The  notation 

sin  w0  k 
Sk'  (ccn)  - — 

N u Sill  CJq 

will  be  used,  as  will  the  solution  for  Wj*.  the  converged  value  of  the  j1*1  weight,  given  by 

Wj*  = cos  (coq  (j  + A) | . 
where  the  delay  is  A and  the  filter  length  is  L 
Thus,  for  a DFT  of  K points. 


K-l 

K-l 

v — ' 

K_1 

M = E 

% rtkldlcoscoQls 

= E 

^ Wjtk)  x (k-j-A) 

k=0 

I 

k=0 

J=0 

X cos  ocgk 
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K-l  K-l 

S 2 e nv  + Vj ( k )]  | A sin  |ocq  (k-j-A)  + ) 

k=0  j=0 

+ n (k-j-A))}  cos  cogk 
K-l  K-l 

2 I i A Wj*  sin  [coq  (k-j-A)  + 0 | + A E | Vj(k)} 
k=0  j=0 

X sin  [cjq( k-j-A)  + 0 | + Wj*  E jn(k-j-A)} 

+ E { Vj  ( k ) n < k -j  - A ) } | cos  coq  k 
K-l  K-l 

A I I Wj*  sin  |coy  (k-j-Al  + t)  | cos  Wgk 
k=0  j=0 

K-1  K-l 

•~a^  ^ 'y  *y  sin  (cog  (k-j-A)  + 0 1 cos  [coq  (j+A))  cos  togk 
k=0  j=0 

K-l  K-l 

^2  I sin  | cogtk-j-A)  + 0 1 jcos  cog  (j-k  + A) 
k=0  j=0 

+ cos  coq  (j  + k + A)} 

K-l  K-l 

'-4^—  ^ ^ jsin  [2ojq  (j-k  + A)  + y]  + sin  [d  1 

k=0  j=0 

+ sin  | coq  ( 2j  + 2A)  - 0 | + sin  [ cjq  ( 2k ) + 6 | J 
K-! 

y>  |s|^(coq)  sin  [wq  (K—  1 ) - 2cjQ(k-A)  + 0 1 + K sin  0 
k=0 

+ S]^(coq)  sin  |<oq(K-  1 ) + 2cjq  A - 6 1 + K sin  ( 2u>gk  + 6 1 J 

|k“  sin  0 - S|^~  ( coq ) sin  | coq ( K — 1 ) - coq(K  - 1 ) 

— 2 coq  A — (/ 1 + K S- ( coq ) sin  [coq  (K-  I ) + 2wq  A - 0\ 

+ K Sjj(  coq)  sin  | coq  ( K- 1 ) + 0 | 
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* A 

a A 

2L 


Let  A = 1 for  the  white  noise  delay  value.  This  gives  the  following: 


E(u)  = a sin  d |s^- (coq)  sin  (2cjq  + d) 

+ K S|^(  coq  ) sin  [ojq(K  + I ) - 0 K K Sj^(coq)  sin  [ coq(  K-l ) + 0 | | 


a*  AK"  . ,,  , a*  A c . . . n ,a. 

— sin  0 + -yj—  S^-  ( coq ) sin  (2o>q  + a | 


a*  AK 


+ — j- — Sj^(ojq)  sin  cjqK  cos  (ojq-0) 
If  cjq  is  bin-centered.  Sj^(ccq)  = 0 and  E(u)  reduces  to 


E(u)  = 


a AK-  . 


2L 


sin  6 . 


(49) 


(50) 


Note  that  when  the  filter  length  and  DFT  length  are  equal.  K = L.  and 


E(u)  = 


a AL  . 


sin  0 


which  agrees  with  the  expression  derived  in  reference  1 . 

By  the  same  analysis,  E ( v ) may  be  shown  to  be  given  by 


Aa*  K- 


Aa 


E(v)  = — q—  cos  t)  - S|/-(coq)  cos  | 2wq  - 0] 


a*  AK 


-j — Sj^  (coq)  sin  ccqK  sin  (tog-tf ) 
If  cog  is  bin  centered  and  K = L.  then  equation  51  reduces  to 


r. / , _ a AL 
E(v)  = — =—  cos  0 


which  agrees  with  reference  I . 

DERIVATION  OF  COMPONENT  VARIANCES 


(511 


(51 


Now,  first  derive  an  expression  for  the  variance,  ot,  , of  the  real  component  of  the 

output  DFT  at  cog  under  conditions  of  signal  present.  The  expression  for  ou“  has  been 
derived  in  section  2 and  is  given  by 

K-l  K-l 

ou~  = ^ ^ 7r(?-k)  cos  cogk  cos  cogC,  K < L. 

k=0  C=0 


(53) 
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where  K = number  of  points  in  the  DFT  and  K is  less  than  or  equal  to  L,  the  length  of  the 
adaptive  filter.  All  subsequent  derivations  assume  K < L.  Substituting  equation  48  into 
equation  53  one  obtains 


9 


K-l  K-l 

2 1 ( a 5 (U-k) + b cos  coy(  d-k) 

k=0  C=0 


+ c ( L—  |C— k I > cos  co0<«-k> 


+ cd  sin  coq  (L  - 1 C— k 1 ) J cos  ccyk  cos  coy  8 


(54) 


where 


i ■» 

a = #ic“  i>~ 


L 


c 


~) 

v~ 


h = Mc2  LA2  = cos  ^0<L+1> 
2 ' sin 


(55) 


The  variance  expression  in  equation  54  can  be  rewritten  as 
au“  = O]  ~ + a-.- + + aq" 


where 


K-l  K-! 


0|2  = ^ a 6(8-k)  cos  coyk  cos  ooyfi 

k=0  8= 0 

K-l  K-l 

a-)~  = I I b COS  COytU-k)  COS  COyk  COS  COyl1 

k=0  8=0 
K-l  K-l 

^ C ( L—  I C — k | ) COS  COy(K-k)  cos  tOyk  cos  iOy8 

k=0  8=0 
K-l  K-l 

aq“  = ^ cd  sin  wy  (L-lV-k|)  cos  cjyk  cos  cuy? 

k=0  C=0 


(56) 


(57a) 


(57b) 


(57c) 


( 5 7 d ) 


The  evaluation  of  these  terms  is  quite  complicated  and  thus  each  term  will  be  treated  in  a 
separate  subsection. 
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A.  Evaluation  of  a i 


Begin  with  0|  “ as  given  by  equation  57a: 


K-l  K-l 


- 2 I a 5 ( t — k ) cos  ojyk  cos  cjq^ 


k=0  ft=0 


rv—  i ix— i 

= a ^ cos- cjQk  = "T  ^ (l+cos2cjgk] 


a ^ + 4 S^(cjq)  cos  coq  (K- 1 ) 


B.  Evaluation  of  a->‘ 


Begin  with  a->-  as  given  by  equation  57b: 


K-l  K-l 


^ b cos  ojQ(C-k)  cos  cogk  cos  coqC 


k=0  C=0 


I I b | cos  coqC  cos  cjQk  + sin  coqC  sin  cogk  | cos  cdgk 


k « 


X COS  OJqC 


b jcos-  cogt  cos-  ccq k +-^-sin  2cjQk  sin  2coqC^ 


k C 


= ^ ^ | 1 + cos  2 ojq  C + cos  2 icq  k + cos  2 ojQ(K-k ) 1 


k « 


= -^  I K + Sk  (coo1  cos  * + cos 

k=0 

+ S ^ (goq)  cos  l^O*  ' * ~ 2wgk|  ] 

= -j  |k“  + K S ^ (coq)  cos  cjq (K-l ) + K S (tog)  cos  goq(K-I  ) 

+ s2k  ,«o>] 


bK-  K b sK,to0)  r 1 1 fK (coo)~| 

= -4  + 2 [cos  uq(  K- 1 ) + 2K  J . 


C.  Evaluation  of  03“ 


Start  with  03“  as  given  in  equation  57e: 


K-l  K-l 

03“  = ^ ^ c (L-|C-k|)  cos  cjQ(C-k)  cos  cjQk  cos  coqC  . 

k=0  K=0 

Using  a series  of  trigonometric  identities,  this  can  be  written  as 

K-l  K-l 

O}-  = ^ ^ 1 1 + cos  2ojQ(8-k)  + cos  2cogk  + cos  2 cog  Cl 

t!=0  k=0 

K-l  K-l 

- j-  lC-k|  1 1 + cos  2cjQ(C-k)  + cos  2o)Qk 

C=0  k=0 

+ cos  2 ccq  S ] 

= S,  - S:  • 

Sum  the  first  summation  Si  over  the  k index: 


rv-  1 

Sj  = ^ |K  + S|^(coq)  cos  |wq(K- 1 ) - 2coq8| 


+ Sj^(cjq)  cos  cjq(K-  1 ) + K cos  2gjq81  . 


Then  sum  over  £: 


Sj  = -^  ^K“  + S^-(coq)  + 2K  S|((ouq)  cos  cjq(K-1  )J 


Now  expand  the  second  summation  S2  from  equation  63  and  remove  the  absolute  value 
notation : 

K-l  C-l 

^2  = *r  ^ (C-k)  [ I + cos  2ojQ(C-k)  + cos  2cjQk  + cos  2cuq2] 

C=0  k=0 

K-l  K-l 

+'4“  ^ ^ (k-6)  [ 1 + cos  2cog(C-k)  + cos  2cogk 

C=0  k=C 

+ cos  2cogC]  (( 

= ^2, 1 + ^2,2  ■ 

Expand  ] by  summing  over  k: 


K-l 

S2. 1 = 4*  ^ C~  + C SK  (wg)  cos  [cog(K-l  > - 2oj0GJ 

c=o 

C-l 

+ C Sk  ( wq ) cos  coo (K - 1 ) + C - c°s  2 cog  C - ^ k 


*-}  C-l 

k cos  2to0(k-C)  - Y kcos2cc0k 

L="n 


C-l 

-cos  2 cog C y k 
k=0 


The  final  four  summations  may  be  written  in  closed  form  with  the  aid  of  the  identities  in 
the  appendix,  giving: 

c K-  r 

S2. 1 = r:  + SK<aj0)Ccoslw0(K-n-2w0C| 

c=o  L 

+ S|^(cOg)  C COS  COg(K-  1 ) + C_  COS  2tOgC  - — ^ -* 

1 (J  Sin  cogC 

+— i — 1 2 sincjn(C+I) 

- u cjq  sin  cjq  u 


1 d s‘n  ^0^  . . . C(C- 1 ) "I 

2 d cog  inr^  sinw0<e->>  2 cos  2<JgGj 


Combining  similar  terms  and  grouping  the  derivative  terms  together: 


I A. 

- dcjQ 


sin  tonC 

[sin  u>o^+ 1)  - sin  tog(C-  1 ) 1 


sin 


w0 


1 _1_ 
2doj0 


sin  coqC 

— 1 2 sin  ton  cos  conC  I 

sin  coq  u u 


{sin  ooqC  cos  gjqC  } - K cos  2u>q(! 


from  which  we  get: 

S2.1  =T  X 


K- 

6=0 


C-+C  , 6~+3fi  ^ n 

— — + — ^ — cos  2 cog  6 


+ Sj^(coq)  [C  cos  [ 2ojqC  - coq(  K—  1 ) 1 

+ e cos  co0(K- ml 


Now  sum  over  6: 


S2,1  =T 


k1 * 3-k 


6 +2 


^7  — — — ^ Sj^(oJq)  COS  GOq(  K — 1 ) 
dCOQ- 


1 dtjQ  SK(aJ0)  sin  wq(K-1  )' 


Si^ftOn) 

+ K ( K - 1 ) — ^ — cos  ojq  ( K - I ) 


giving 


s2. 1 = J |^^  + 3K'4K  " Sk(oj0)cosco0(K- 


1) 


+ SK'  (coq)  sin  coq(K-  1 ) 

-- (wq)  cos  cog(K- l)j  (h2) 

Now  return  to  St  t given  by  equation  65  and  make  the  substitution  n=k-C.  giving 


1 


(66) 


K-i  K-i-e 

S-i  7 j ^ ^ [n  + n cos  2togii  + n cos  2coo<n+^  + n cos  2coqC1 

8=0  n=0 

(68) 


30 


Summing  over  n: 


r 


I\.~  ! 

;2,2  =1~  S 


K-l 

s 

£-0 


(K-£HK-£-l)  + 1 d 


2dw0 


sin  oJn(K-£) 

sin  coq  ( K-l-£) 


sin 


1 d 


2dco0 


Sill  COy(K~£) 


Sill  CO 


0 


-sin  coq  (K-  1 +0 


+ (K-E)(K-1-J)cos2  g 


ix—  i 

.2-il 


K-l 

2 

£=o 


(K  — K)  + £(l-2K)  + £- 


d cjr 


sin  coq(K-B)  sin  coq(K-  1 ) cos  coq£ 


Sill 


co0 


Now  sum  over  £: 


s2,2  =T 


,(K2-K)  + £(I-2K)  + £-  , 0 

+ cos2coqv 


K3-K2  . K(  1 -2K)(K- 1 ) . 2K3-3K2  + K 

- T“  3 + U 


K-l 

y -A 

dcor 


£=o 


COq 


sin  coq(K-  1 ) sin  cjq(K-£)  cos  coq£ 


Sill 


w0 


+ 


i^r1)  sk«v 


COS  COq(  K—  1 ) 


- ^ ' ) S[^ ' (coq)  sin  coq(K- 1 ) 

-■g  SK"  (cjq)  cos  coq(K-1  ) 


(69) 


The  summation  of  the  derivative  term  leads  to  a complicated  expression,  to  say  the  least. 

To  evaluate  equation  69.  the  differentiation  of  the  second  term  was  carried  out.  then  the 
resulting  terms  summed  over  the  £ index.  The  S|^'  (coq)  and  Sj^'  (coq)  terms  appearing 

were  expanded  using  equations  A10  and  A 1 5 from  the  Appendix.  Then  terms  were  grouped 
according  to  frequency  dependence,  giving 
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S2,2  ~ 4 


c |k3-k 


+ 5 


6k-+2k-3 

8 


COS  COq(K-  1 ) 


sin  u>Qtk-2) 


. / k + 1 \ „ . , . w( 

( 2 ) ‘ ^ w0  4 sin  u)q 

(7K-3)  cos  cjq  - (k  + I ) 


cos 


8 sin  ccq 

, K“-K 


sin  ccq(K-  1 ) 


wo  ■ — : f 

COS 

K 


cos  CJq  k 


. /^0_\COSWo(K-2 

\4  sin-  a>n  / 

1 - COS”  COq  + cos  GJq  cos  OJq  (2k-  1 ) 


4 sin  - ccq 


k cos  CCQ  k 


( I + COS  C0q)  COS  OJq  ( k-  1 ) 


4 sin  o)q 
+ ( k- 1 ) cos  cjQk 


2 Sill 


co0 


(70) 


The  expression  for  o^~  is  now  a combination  of  equations  64.  67  and  70.  Rewrite 
equation  64  as 


S1  = £if"+^Sk^0>Fl  <KL-“0> 


(71) 


First  observe  that  if 


7T  m . . , 

cug  = -jr  (m  - integer). 


then 


SK  (to0)  - 


sin  cJgk 


sin 


= 0 . 


This  is  the  case  of  signal  frequency  being  exactly  bin-centered  or  exactly  on  bin  boundaries 
of  the  k-point  FFT.  When  S[^(wq)  vanishes  then  S|  reduces  to 


e Lk~ 


S1  = 4 


(72) 
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Even  when  gjq  is  not  at  these  critical  frequencies,  the  function  Fj  (KL.coq)  is  much  less 

than  LK-  by  a factor  of  1/K.  The  notation  KL  in  F , (KL.cuq)  represents  the  highest  order 
Products  appearing  in  the  function.  As  w0  0 or  cc0  - n,  then  SK(w0)  - K and  a term 

approaching  a magnitude  LK~  does  appear.  However,  as  long  as  7r/L  < ccq  < n (L-l  )/L 
work  can  be  done  accurately  with  the  approximation 

S[^(cjq)  K 

from  which 

SK(W0)F,(KL.co0)  < K~L 

which  will  allow  the  approximation  to  S|  as  given  by  equation  72. 


The  term  St  | from  equation  67  may  be  rewritten  as 

S2,1  =t[V]  “if  [f]  + sK(wo>F2  (k2-K^o) 

+ SK’  (w0)  F3  (K.wq)  + Sk"(cjq)  F4  (w0) 

The  behavior  ot  S|^'  (ojq)  and  Sj/'  (cog*  *s  examined  in  the  Appendix.  The  result  is  that  as 
long  as  ojq  is  sufficiently  removed  from  0 or  7r.  the  expression  for  St  | is  dominated  by  the 
first  term.  Thus  S->  j may  be  approximated  by 


(73) 


I he  same  approach  may  be  taken  toward  St  t as  given  by  equation  70,  which  may 
be  rewritten  as 


S-, 


1 


+ JF6  <w0.K2.K)  . 

For  ojq  not  near  the  critical  frequencies,  the  approximation  becomes: 


(74) 


(75) 
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By  using  equations  63a,  72,  73  and  75  the  useful  (and  workable ) approximation  to 


CT^-  then  becomes: 


V = S,  -S-,  , -S- 


v3 


~ i LK-  cK~  _ ,,2  / L K \ in  \ 

~ ~ ~l2  ' cK  U-r?)  ,76) 

Note  that  when  the  transform  length  K equals  L,  the  filter  length,  then 
•">  c 

°3  = — 


which  agrees  with  the  result  in  Medaugh’s  derivation. 

L).  Evaluation  of  04- 

The  evaluation  of  oj-  as  given  by  equation  57d  produces  a result  of  the  following 

form : 

04“  =-^|S]^(oJq1G]( coq. K L)  + S^(coq)Ci->( coq. K L. ) + C> ^ ( coq. K . L)  1 . 

Thus,  for  rr/L  < cjq  < n (L-l  )/L  this  term  has  a magnitude  on  the  order  cK.L/2.  which 
is  much  smaller  than  the  expression  for  o^“  as  given  by  equation  76.  Thus  the  working 
approximation  to  a^~  will  be 


04"  = 0 . 

USEFUL  VARIANCE  EXPRESSION 


(77) 


The  useful  approximation  to  the  variance  of  u is  now  obtainable.  By  the  preceding 
arguments,  the  following  approximations  are  valid  for  7r/L  < coq  < 7r  < L—  1 )/L  : 


0 

By  equation  59,  0 1 - 

__  a K _ pc-  v~  LK 
— ")  1 

(78) 

By  equation  61 , or 

_ bK-  _ pc-  A"  LK- 
“2  8 

(79) 

By  equation  76,  03" 

_ 1 L K \ - *->  2 K-  (L  K \ 

- ck“\T-T2)  - 2a  \J- n) 

(80) 

By  equation  77.  a4~ 

S£  0 . 

(81) 
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The  expression  for  the  approximation  to  ouz  is 


2 ^ pc2i»2LKi/iC2A2LK2J.2a*2v2K2  /L  K\  „ . , 

°u  " 2 + 8 + — 2~  IT' 12/  ’K<L 


(82) 


By  the  symmetry  of  the  DFT  operation,  the  extension  to  the  variance  of  the  imaginary  com- 
ponent  ov~  may  be  made,  giving 

j -> 

av  = ou-  (83) 

When  the  transform  length,  K,  equals  the  filter  length  L,  equation  82  becomes  the  variance 
expression  derived  in  reference  1 : 


1 1 
nc~  v~  L~ 


2 * ■*  i 3 

+ /■“-  A-  L~  + a_ 


v-  L 


where  a = 


2/ac~  L in  reference 


1. 


(84) 


Having  obtained  the  results  in  this  section  one  may  proceed  with  developing  the 
probability  density  function  for  the  ALE  output,  as  outlined  in  Section  2.  The  desired 
mean  values  u and  v are  given  by  equations  49  and  5 1 , respectively,  and  useful  approxima- 
tions to  the  variances  oL1~  and  av“  are  given  by  equations  82  and  83.  respectively. 
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APPENDIX 

USEFUL  CLOSED  FORM  EXPRESSIONS  FOR  FINITE  SUMMATIONS 

In  deriving  the  variance  and  mean  solutions,  it  is  necessary  to  employ  closed  form 
expressions  for  finite  summations  of  trigonometric  terms.  From  reference  3,  the  formula 
obtained  is: 


y sin  (ka  + b)  = 
k=0 


(^T  a)  (y*  + b) 


cos  (ka+b)  = 
k=0 


Specifically,  let  n = K - 1.  a = 2coq: 


/ n + 1 \ / n \ 

sin  I — a I cos  f — a + b 1 


is.- 1 

V ^ Sill  Wnk 

y sin  (2ccQk  + b)  = sin  [ccq  (K- 1)  + b] 

k=0  W° 

= Sj^  (coq)  sin  Icjq  (K- 1 ) + b|  . 

K-l  „ 

\ ' sin  conK 

y cos(2coQk  + b)  = yyy — cos  [ojq  (K- 1)  + b] 


SK  (tog)  cos  ( coq  (K-l ) + b| , 


Si/  < co ) 


sin  o>K 


By  taking  derivatives  of  equations  A3  and  A4.  the  following  relations  may  be  obtained 
K-l 

k cos  (2ojgk  + b)  = 4 yj-  |S|^(cjq)  sin  (coq  (K-l ) + b]} 
k=0  " W° 


IV-  I 

*y  k sin  (2uiQk  + b)  = “"Tjy"  jS^fcog)  cos  (cjq  (K-l ) + b] } <A(>) 
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Further  differentiation  of  equations  A5  and  A6  gives: 

K-l 

^ k-  co;  v-wgk  + b)  = ~ 4 |SK  (coq)  cos  | coq  ( K - 1 ) + b] } 


( A 7 ) 


k=0 

K-l 


vp  1 d - 

2 k“  sin  (2w0k  + b)  = t |SK(o;0)sin  |o>0  (K-l)  + b||  . (A8) 


k=0  uw0 

Carrying  out  the  differentiation  in  equation  A5. 

K-l 

V k cos  ( 2 u>o k + b ) = { SK'  (<oQ)  sin  |cjq  (K- 1 > + b| 


k=0 


+ ( K- 1 ) Sjf  ( cjq)  cos  | a>g  ( K - 1 ) + b | } 


K SK ’ <Wrv) 

<wq)  cos  |wq  (K-I ) + b]  + y sin  |cog  (K-  1 ) + 

SK  ( CCq  ) 

y cos  | coq  ( K - 1 ) + b | 


(Ah) 


wliere 


SK,aj0>  - daT0 


sin  coq  K"|  cos  cog  K 


w0  J 


= K — 


_SK  (OJ0> 


COS  C Cl 


(A10) 


sin  coq  o-  o sm  ojq 

The  term  Sj^  (cog)  is  ^ K as  long  as  7r/L  < cjq  < 7r  < L—  I )/L.  The  behavior  of 

these  critical  trequencies  may  be  seen  either  from  examining  Figure  3 or  taking 
the  limit  of  both  sides  of  equation  A 10  as  ojq  -*  0 (or  wq  — 7r): 

; co0  K 

ok  vcorV  _ xim  | is.  — t 

OJg-0 


cos 

8im  SK'(u)g)  = Cim  K — — 
~ u [_  sm 


cos  cog] 
SK 


COg->0  L S"1W0  " 'U'sm«g_ 

Using  L Hopital’s  rule,  the  limit  on  the  right  is  shown  to  be  zero.  Thus, 

Cim  SK'(wg)  = 0 . (All) 

Wg^O 


1 


Returning  to  equation  A9,  the  limit  of  both  sides  is  taken  as  co  -»  0 and  the  result  from 
equation  A 1 1 is  used: 


dim  ^ k cos  (2cogk  + b)  = Cim  N^Sj/(cog) 

w0~*°  k=0  w0-0  L- 

-SK  <«0>]  cos  [co0(K-l)  + bl 


giving 


K-l 

k cos  (b) 
k=0 


"ii2  _ ill  • 
2 ~ 2 


cos  ( b ) 


For  phase  angle  b = 0 this  gives  the  familiar  formula  (reference  3 ) 


k cos  ( 0 1 


y k . 


iai:i 


Thus  the  maximum  value  of  the  summation  in  equation  A5  is  given  by  equation  A1 2.  For 
cog  = 0 or  co  = 7r.  the  summation  may  introduce  terms  on  the  order  of  K~  (K  = filter  length 
or  number  of  points  in  DFT).  dependent  on  the  phase  angle  b.  A similar  analysis  will  show 
that  the  summation  given  by  equation  A6  has  the  same  maximum  value  of  — -*  and  this 

is  obtained  when  cog  = 0,  jt  and  b = n/2.  The  value  of  both  summations  in  equations  A5  and 
A6  decays  quickly  for  cog  away  from  0 or  n due  to  the  weighting  by  the  S|^  (cog)  terms. 

Next  are  derived  the  bounds  for  the  summations  of  equations  A7  and  A8.  Carrying 
out  the  differentiation  specified  in  equation  A7, 

K-l 

/ k - COS  ( 2 COg  k + b ) = - -J-  — — { S|^  ( COg ) COS  I cog  ( k - 1 ) + b 1 } 
k=0  dw()“ 

= “idw  lsK  ,a,0)cos|w0(K_I)  + b| 

— (K—  1 ) S|^  (cog)  sin  [cog  (K  - 1 ) + b] } 
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40 


Application  of  L’Hopital’s  Rule  (and  steadfast  perseverance)  gives 


Gim  Sj("  (cjq)  = - K3  + 
coq  -*  0 


K3  + K 
3 

Substituting  this  result  in  equation  A 14  gives 


This  last  result  may  be  factored,  giving  the  familiar  identity  (reference  3) 
K-l 


I 

k=0 


(K-  1)K(2  K-  1) 
6 


( A 1 6 ) 


( A 1 7 ) 


( A 1 8) 


The  result  from  equation  A 1 7 shows  that  for  ccq  -*■  (0, 7r)  summation  equation  A7 

may  introduce  terms  on  the  order  of  K3.  A similar  analysis  for  the  summation  in  equation 
A8  gives  the  same  maximum  value  as  coq  *♦  (0,  it).  As  in  the  previous  derivation,  the  summa- 
tions equations  A7  and  A8  decay  quickly  as  coq  is  moved  away  from  u>g  = (0,  it). 
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